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ABSTRACT 

The Medical/Dental Education Preparatory Program 
(MEDPREP) at Southern Illinois University School of Medicine at 
Carbondale prepares underrepresented minorities for medical school 
admission. This paper reports on the evaluation of the MEDPREP Suaaer 
Review program by the comparison of participant and non-participant 
score gains on the Medical Ccllege Admissions Test ifKlM) , The eight 
week Summer Review courses review biology, chemistry, physics, and 
quantitative topics covered by the WChT, Data were collected from all 
MEDPREP students from 1977 to 1983 having MCAT scores from both 
before and after MEDPREP enrollment. The review program resulted in 
significant gains in all subtests, compared to moderate gains on 
three subtests by nonparticipants. Summer Review group gain was 
significantly greater only on th» Quantitative subtest. While this 
study demonstrates the ability of the Sunmer Review Program, other 
factors may be responsible for the gains. (BS) 
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Much research has been done on the effects of coaching for standardized 
aptitude and achievement tests. The review of the literature reveals varying 
results depending cn the structure, content and methods used in, the preparation 
program. Ir. appears that coaching is most effective if a broad-based per-* 
spective is taken when planning for the improvement of scores (McGee and Rose» 
1982). Additionally, as pointed out by Anderson (1981), there are two parts 
to coaching for tests: 1) training in test-taking skills or "test-wlseness" 
and 2) coaching in the skill areas of knowledge measured by the test. 

Sarnacki (1981) considered the effects of test-wlseness training and level 

4 I. 

of test-wlseness (TW) on multiple choice item type performance on standardized 
(NBME, Part 1) and teacher-made examinations in undergraduate medical education. 
He found that those subjects trained in TW skills obtained significantly 
higher mean scores on one of four multiple choice formats (K-type) . However, 
no significant diff^reiltes were evidenced on either of two in-house teacher-^ 
made examinations. It was therefore concluded that certain conditions, inherent 
only in standardized tests, must be present before susceptibility to the 
extraneous source of variance of TW is evidenced. 

V 

In a survey of review programs for the Part I Exam of the National Board of 
Medical^ Examiners (NBME) by Litzlnger and Welker (1979), twenty-nine of seventy- 
nine respondent medical schools Indicated an organized program of board prepar- 
ation. The offerings consisted primarily of lectures and/or self-study, 
employing the use of review questions, test-taking Practice and programmed 
sessions. Weber and Hamer (1?82) studied the effect of review courses ; 
upon students*. NBME Part I performance and found a school' s policy of offering 



or recommending a review course was associated with a small, but statistically 
significant increment in **art I scores. 

Jones and Beran (1980), In a descriptive study on repeat test performance 
on the MCAT, found significant score changes for all six subtests. Scores 
in the Reading and Quantitative skills areas were found to be more constanf: 
than the four science areas, possibly because the latter measure taore directly 
fche knowledge and skills learned in couvses of study. Of the science subtests. 
Chemistry had the lowest mean increase, but the dispersion of scores on the 
repeat administration was larger. The science subtest with the greatest 
improvement in both absolute score units and standard deviation units occurred 
in Science Problems. Although there was no accounting for what students did 
between the two administrations of the test, the authors felt that scores on 
MCAT subtests more related to a specific discipline would be influenced by 
preparation and review activities which were delivered over an extended period 
of time. 

Hynes and Givner (1980) found significant improvement in MCAT subtest 
scores on a second testing occasion for those students whose performance was 
lower than predicted on the basis of past academic performance. The students 
whose performance was better than predicted, on tlje other hand, failed to 
demonstrate significant improvement on the second test. 

BACKGROUND . Southern Illinois University School of Medicine is, and has 
been, committed to increasing the number of practicing minority physicians and 
dentists. For thirteen years (September 1972 - present) SoutherK Illinois 
University School of Medicine has operated a year-round program to increase the 
number of applicants from groups traditionally under represented in medicine and 
dentistry. The Medical/Dental Education Preparatory Program (MEDPREP) is 
- located on the Carbondale campus. 
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MEOPREP has its own teaching faculty and special tutorials^ scsnlnars and 
classes are offered to enrolled students. MEDPREP students also enroll In 
regular preprof esslonal university courses offered on the Carbondale campus. 
MEDPREP is not a degree-granting program. It is designed to help undergraduate 
as well as post baccalaureate students enhance their credentials for applying 
to professional school. 

MEDPREP *s academic offerings range from courses designed to review the 
basic science areas required by most medical schools to developmental courses 
In basic skills to enriched science courses which are representative of first- 
year medical school coursei^rk. As a program of the SIU School of Medicine f 
MEDPREP is also able to provide students with unique experiences and courses 
not usually available to preprof esslonal students. MH)FREP students have 
opportunities to interact with medical students and faculty and to observe 
the delivery of health care in area health facilities. 

As part of Its program to prepare underrepresented minorities for 
admission to medical school, MEDPREP conducts a program unofficially called 
'^Summer Review.'* Students register for a total of six hours of roursework 
offering review in the biology, chemistry, physics and quantit^^cive topics 
covered by the MCAT. MEDPREP follows the university's 8 week summer term 
schedule and classes for the above four courses are held 5 days a week, 
roughly from 7:30-3:50 with a 45 minute lunch break. There are approximately 
60 hours of scheduled biology lectures, 26 hours of physics review, 22 hours 
of inorganic chemistry, . 20 hours of organic chemistry and 26 hours of quant 
review. In addition to the scheduled lecture hours, help sessions conducted 
by the various instructors are interspersed throughout the schedule. In 
order to evaluate the effectiveness of the Suniroer Review Program, data were 
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collected on 52 students participating in the program between 1977 and 1983 
who had taken the MCAT examination prior to enrolling axul who subsequently 
retook the examination following the review* A control group consisted of 
students during the same period of time %rho enrolled in HEDPREP without 
taking the Summer Review and for whom two sets of MCAT scores were available. 
The purpose was, of course, to compare the gains of each group and to 
determine the effectiveness of the Summer Review program.' 

METHOD . The sample of subjects is described above: all students in 
MEDPREP from 1977 to 1983 who had two sets of MCAT scores, one sec taken 
before enrolling in MEDPREP and one set after. Comparisons of scores to 
determine gain« if any, were made for two separate groups of students: those 
who participated In the Summer Review program designed specifically to review 
science topics tested by the MCAT, and those who did not participate in the 
eight-week review program. Statistical comparisons were made using analysis 
of covariance with the first set of MCAT scores, as covarlates. Analysis of 
variance with repeated measures was also performed to check the consistency 
of the results from the covar lance analysis. As a follow-up, gains between 
groups were compared using the independent t'-test, and paired t-tests were 
used to examine gains within each group. 

RESULTS . Fifty-'two students who had two sets of MCAT scores participated 
in the Summer Review program during the seven-year period* Gains were made 
in all MCAT subtests, significant at •DOS in Reading Skills and significant 
at .001 in other subtests (see Table 1). The control group who had two 
sets of MCAT scores but did not participate in the summer program numbered 21, 
and were observed to have significant gains only on the biology, physics » and 
science problems subtests, all at the .05 level. When the gain scores were 



compared for the t%io groups (Table 2) « only on the Quantitative subtest did 
the Suomer Review group demonstrate a more sigfnlf leant gain than the group 
with no review* The results of these analyses were confirmed by the analysis 
of covarlance (F « 6.51, p « ,013 for the Quantitative subtest; all others 
not significant) and the repeated measures analysis (F ^ 8,17t p ^ -006 for 
the Interaction term on the Quantitative subtest; all others not significant). 

DISCUSSION . The present study has deaaonstrated the utility of a Summer 
Review program designed to help traditionally underact\levlng students Improve 
their scores on the MCAT examination. The review program resulted in signifi- 
cant gains on all subtests , compared to moderate gains on three subtests 
achieved by a group of student s who did not participate in the review program. 
The actual amount of gain in scores was statistically greater in the Summer 
Review group only on the Quantitative subtest. 

It may be, of course, that factors other than the review itself are 
responsible for the gains. The students were not randomly assigned to review 
or not review, and it may be that those who took the review program were more 
motivated to improve their scores. The group taking Summer Review may have 
been more motivated because their MCAT scores, on the average, were lower 
than those not taking the review. On the other hand, it couli be argued that 
students who Lake such a review course are most in need of a structured format 
for review. 

The fact that three of the scores increased for the group who did not part 
pate in the Summer Review program may mean that these students studied thet>e 
topics on their own. It is logical to expect that students review the topics 
thr,t are outlined for students in the MCAT Student Manual prepared by the 
Assoi^iation of American Medical Colleges. While it 1b a matter of record that 



Ch.ey ddd not take' the 8~i^elt' SuiiiBer Review offered by NEDPREP it has not been 



determined what other course vork they may have taken or what preparatory 
material they may reviewed* The fact that the Quantitative subtest scores 
were unchanged for this group may be a function of the difficulty there is 
in finding a cla^» that would be good preparation for this subtest. 
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